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METHOD AND APPARATUS FOR SCHEDULING MESSAGE PROCESSING 

FIELD OF THE INVENTION 

[0001] The present invention relates generally to the field of communications and, more 
particularly, to a method and apparatus for scheduling messages for processing. 

BACKGROUND OF THE INVENTION 

[0002] The increasing demand for data communications has fostered the development of 
techniques that provide more cost-effective and efficient means of using communication 
networks to handle more information and new types of information. One such technique is to 
segment the information, which may be a voice or data communication, into packets. A 
packet is typically a group of binary digits, including at least data and control information. 
Integrated packet networks (typically fast packet networks) axe generally used to carry at 
least two (2) classes of traffic, which may include, for example, continuous bit-rate ("CBR"), 
speech ("Packet Voice"), data ("Framed Data"), image, and so forth. Packet networks 
source, sink and/or forward protocol packets. 

[0003] Congestion and Quality of Service ("QoS") problems inside these networks have 
not been solved satisfactorily and remain as outstanding issues to be resolved. Although, 
message scheduling helps alleviate these problems, the efficient scheduling of work with 
thousands of entities (instances) is not a simple matter. At present, most message scheduling 
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is based on the simplest technique for queuing packets for transmission on an internodai 
trunk of a fast-packet network: a first-in-first-out ("FIFO") queue. However, FIFO queuing 
techniques do not address QoS parameters. This technique can also allow overload periods 
for digitized speech packets and for Framed Data packets, which results in a greater share of 
bandwidth being provided to one at the expense of the other; an undesirable result. 

[0004] Another technique, head-of-line-priority ("HOLP"), may give data priority over 
speech, but does not solve the problem of data and speech queues affecting the QoS of each 
other and of CBR data fast packets under high traffic conditions. In HOLP, where speech 
fast packets are given a high priority, speech fast packets may affect the QoS of lower 
priority queues. Likewise, queuing schemes designed only for data do not solve the 
problems of integrating other traffic types, such as speech and CBR data. 

[0005] Most current techniques for scheduling messages depend upon the storage of 
messages either in FIFO order or priority order. Current messaging queues are not flexible 
because they do not take into account any current or historical operating conditions. In 
addition, current functionality is often dependent on a single central processing unit ("CPU") 
and memory. 

[0006] Accordingly, there is a need for a method and apparatus for scheduling messages 
based, in part, on current and historical operating conditions. There is also a need for a 
method and apparatus that reduces congestion while maintaining QoS for all message types. 
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SUMMARY OF THE INVENTION 

[0007] The present invention provides a method and apparatus for scheduling messages 
based, in part, on current and historical operating conditions. The present invention also 
provides a method and apparatus that reduces congestion while maintaining QoS for all 
message types. The present invention is adaptable to accommodate new message types, 
multimedia applications and multi-service applications. It is flexible, with the ability to cater 
to a wide range of configurations and environments and improves the QoS of VoIP calls. 
Moreover, the present invention self-adjusts to traffic/congestion levels through its multiple 
operating modes. Furthermore, the mode switching points can be adjusted on the fly. 

[0008] The representative embodiments described herein provide a scheduling mechanism, 
or scheduler, that receives messages and stores the messages in a first queue and a second 
queue based, in part, on various criteria associated with the messages. The criteria include 
message attributes, such as message priority, virtual private network ("VPN") classification 
and destination software function. The first queue can be a first-in-first-out queue, and the 
second queue can be a multi-dimensional queue. The scheduler then schedules the queued 
messages for processing based, in part, on various operating criteria, such as historical 
operating data, current operating data and anti-starvation criteria. In addition, the scheduler 
can be programmed to function in a variety of operating modes. 
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[0009] In a first embodiment, the present invention provides an apparatus for scheduling 
messages that includes two (2) queues and a scheduler communicably coupled to the queues. 
The scheduler has at least two (2) operating modes. The first operating mode includes 
receiving messages, storing each message in the first queue based on a first-in-first-out order, 
and scheduling each queued message from the first queue based on the first-in-first-out order. 
The second operating mode includes receiving messages, storing each message in the second 
queue based one or more message attributes, and scheduling each queued message from the 
second queue based on operating criteria. The scheduler operates in the first operating mode 
until the number of messages in the first queue exceeds a predetermined value and the second 
queue is emptied; then it switches modes. The first operating mode may also be triggered by 
low message traffic conditions. Likewise, the second operating mode may be triggered by 
high message traffic conditions. Additional queues and operating mode can be added to 
extend the flexibility of the present invention. 

[0010] In a second embodiment of the present invention, the scheduler includes a third 
operating mode. The scheduler switches to the third operating mode when the number of 
messages in the first queue equals or exceeds a predetermined value. At this point, the 
scheduler ceases storing messages in the first queue and begins storing messages in the 
second queue. However, the scheduler continues pulling messages for processing from the 
first queue until the first queue is empty. Once the first queue is emptied, the scheduler 
returns to operating in the second operating mode. 
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[0011] Another embodiment of the present invention includes a fourth operating mode in 
which the scheduler stores messages in the first queue and pulls messages from the second 
queue. The scheduler switches to the fourth operating mode when the number of messages in 
the second queue is equal to or less than a predetermined value. The fourth operating mode 
is maintained until the second queue is emptied. Then the scheduler returns to the first 
operating mode. 

[0012] The present invention also provides a method for scheduling one or more messages 
in which the one or more messages are received, and a first queue is selected for input and 
output during a first operating mode and a second queue is selected for input and output 
during a second operating mode. Each message is stored in the first queue based on a first- 
in-first-out order whenever the first queue is selected for input or in the second queue based 
on one or more message attributes whenever the second queue is selected for input. Each 
queued message is scheduled from the first queue based on the first-in-first-out order 
whenever the first queue is selected for output or from the second queue based one or more 
operating criteria whenever the second queue is selected for output. 

[0013] In addition, the present invention provides a communications switch that includes 
one or more ingress cards, one or more signal processing cards, one or more control cards, 
one or more egress cards, a switch fabric, a TDM bus, a scheduler, and a first and second 
queue. Each signal processing card contains an array of digital signal processors and each 
control card contains one or more processors. The switch fabric communicably couples the 
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ingress cards, the signal processing cards, the control cards and the egress cards together. 
The TDM bus communicably couple the ingress cards, the signal processing cards, the 
control cards and the egress cards together. The scheduler communicably is coupled to each 
processor and has at least a first and second operating mode. The first and second queues are 
communicably coupled to the scheduler. The first operating mode includes the steps of 
receiving the one or more messages, storing each message in the first queue based on a first- 
in-first-out order, and scheduling each queued message from the first queue based on the 
first-in-first-out order. The second operating mode includes the steps of receiving the one or 
more messages, storing each message in the second queue based one or more message 
attributes, and scheduling each queued message from the second queue based one or more 
operating criteria. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] The above and further advantages of the invention may be better understood by 
referring to the following description in conjunction with the accompanying drawings, in 
which: 

FIGURE 1 is a block diagram of a representative integrated network in accordance 
with the prior art; 

FIGURE 2 is a schematic diagram illustrating a message scheduling system in 
accordance with the prior art; 
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FIGURE 3 is a schematic diagram illustrating another message scheduling system in 
accordance with the prior art; 

FIGURE 4 is a diagram of a packet network switch in accordance with the present 
invention; 

FIGURE 5 is a schematic diagram illustrating a packet operating system in 
accordance with the present invention; 

FIGURE 6 is a schematic diagram illustrating a message scheduling system in 
accordance with the present invention; 

FIGURE 7 is a flowchart illustrating a method for storing messages into queues in 
accordance with one embodiment of the present invention; and 

FIGURE 8 is a flowchart illustrating a method for scheduling or pulling queued 
messages from queues for processing in accordance with one embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0015] While the making and using of various embodiments of the present invention are 
discussed in detail below, it should be appreciated that the present invention provides many 
applicable inventive concepts that can be embodied in a wide variety of specific contexts. 
The specific embodiments discussed herein are merely illustrative of specific ways to make 
and use the invention and do not delimit the scope of the invention. The discussion herein 
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relates to communications systems, and more particularly, to processing messages within a 
communications switch. It will be understood that, although the description herein refers to a 
communications environment, the concepts of the present invention are applicable to other 
environments, such as general data processing. 

[0016] The present invention is adaptable to accommodate new message types, multimedia 
applications and multi-service applications. It is flexible, with the ability to cater to a wide 
range of configurations and environments and improves the QoS of VoIP calls. Moreover, 
the present invention self-adjusts to traffic/congestion levels through its multiple operating 
modes. Furthermore, the mode switching points can be adjusted on the fly. 

[0017] The representative embodiments described herein provide a scheduling mechanism, 
or scheduler, that receives the messages and stores the messages in a first queue and a second 
queue based, in part, on various criteria associated with the messages. The criteria include 
message attributes, such as message priority, virtual private network ("VPN") classification 
and destination software function. The first queue can be a first-in-first-out queue, and the 
second queue can be a multi-dimensional queue. The scheduler then schedules the queued 
messages for processing based, in part, on various operating criteria, such as historical 
operating data, current operating data and anti-starvation criteria. In addition, the scheduler 
can be programmed to function in a variety of operating modes. 
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[0018] Now briefly referring to FIGURES 1-3, a representative network (FIGURE 1) and 
various message scheduling systems (FIGURES 2 and 3) will be described in accordance 
with the prior art. FIGURE 1 depicts a representative integrated network 100 in which 
phones 102 and faxes 104 are communicably coupled to a public switched telephone network 
("PSTN") 106. A switch 108 is communicably coupled to the PSTN 106 and an Internet 
Protocol ("IP") network 110 to convert time division multiplexing ("TDM") based 
communications 112 to IP-based communications 114. The switch 108 creates IP packets 
containing the necessary destination information so that the packets 114 can be properly 
routed to their destinations, which may include computers 116 or other devices 
communicably coupled to the IP network 110. A network controller 118 is communicably 
coupled to the PSTN 106 and the switch 108, and provides control signals to the switch 108 
for proper processing of the TDM based communications 112. The network controller 118 
may also be communicably connected to the IP network 110. Network controller 118 can 
function as a Media Gateway Control ("MGC"). The MGC protocol is one of a few 
proposed control and signal standards to compete with the older H.323 standard for the 
conversion of audio signals carried on telephone circuits, such as PSTN 106 to data packets 
carried over the Internet or other packet networks, such as IP network 110. As will be 
appreciated by those skilled in the art, this example is not limited to the conversion of TDM 
based communications to IP-based communications; instead, the present invention may be 
applied to any conversion of a multiplexed communication to a packet-based communication. 
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[0019] IP specifies the format of packets, also called datagrams, and the addressing 
scheme. Most networks combine IP with a higher-level protocol called Transport Control 
Protocol ("TCP"), which establishes a virtual connection between a destination and a source. 
IP allows a packaged to be addressed and dropped in a system, but there is no direct link 
5 between the sender and the recipient. TCP/IP, on the other hand, establishes a connection 
between two hosts so that they can send messages back and forth for a period of time. IP 
network 110 receives and sends messages through switch 108, ultimately to phone 102 
and/or fax 104. PCs 116 receive and send messages through IP network 110 in a packet- 
compatible format. Voice over IP ("VoIP") is the ability to make telephone calls and send 
10 faxes over IP-based data networks, such as IP network 110. An integrated voice/data 
network 100 allows more standardization and reduces total equipment needs. VoIP can 
support multimedia and multi- service applications. 

[0020] FIGURES 2 and 3 are schematic diagrams illustrating two message scheduling 
systems 200 and 300 in accordance with the prior art. In FIGURE 2, messages 202 are 

15 received and stored in first-in-first-out ("FIFO") queue 204. Messages 202 are then sent to 
processor 206 in the order in which they were received. No processing prioritization other 
than arrival time is applied in queue 204 is applied. In FIGURE 3, messages 302 enter data 
type sorter 304 where messages 302 are separated by data type. A FIFO queue 306a, 306b, . 
. . 306n exists for each individual data type. Data type sorter 304 sends messages 302 to 

20 FIFO queues 306a, 306b ? . . . 306n based on matching data types. Scheduler 308 then pulls 
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messages 302 from FIFO queues 306a, 306, . 306n and sends messages 302 to processor 
310. The primary prioritization is again based on arrival time in queues 306a, 306b, . . . 
306n. Scheduler 308 only coordinates the pulling of messages 302 for processing. 

[0021] Now referring to the present invention and to FIGURE 4, a packet network switch 
5 400 will now be described. The packet network switch 400 can be used to process VoIP, 
voice over Frame Relay ("VoFR") and other types of calls. Moreover, the packet network 
switch 400 is similar to an asynchronous transfer mode ("ATM") switch. ATM is a 
connection-oriented technology used in both local area network ("LAN") and wide area 
network ("WAN") environments. It is a fast-packet switching technology that allows free 
10 allocation of capacity to each channel. Packet network switch 400 includes one or more 
ingress cards 402a and 402b, one or more signal processing cards 404, one or more control 
cards 406, one or more egress cards 408a and 408b, a switch fabric 410 and a TDM bus 412. 
Each signal processing card 404 contains an array of digital signal processors ("DSP") (not 
shown) and each control card 406 contains one or more processors (not shown). The switch 
15 fabric 410 communicably couples the ingress cards 402, the signal processing cards 404, the 
control cards 406 and the egress cards 408 together. The TDM bus 412 also communicably 
couples the ingress cards 402, the signal processing cards 404, the control cards 406 and the 
egress cards 408 together. Preferably cards 402, 404, 406 and 408 can be inserted in any 
order within packet network switch 400. Moreover, the packet network switch 400 should 
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include sufficient numbers of redundant cards to serve as backup cards in the event a card 
402, 404, 406 and 408 fails. 

[0022] The main function of a packet network switch 400 is to relay user data cells from 
input ports to the appropriate output ports. When a call or communication is to be handled 
by the packet network switch 400, a network controller 118 (FIGURE 1) provides the control 
card 408 with the necessary call setup information. Control card 408 uses this call setup 
information to assign a port in ingress cards 402a or 402b to receive the call from the PSTN 
106 (FIGURE 1), a DSP within processing card 404 to process the call, and a port in egress 
cards 408a or 408b to send the call to IP network 110 (FIGURE 1). The TDM-based 
communications or messages 1 12 enter through ingress cards 402a or 402b and are routed to 
the appropriate processing card 404 through TDM Bus 412. The DSPs in processing card 
404 convert messages between analog and digital information formats, and provide digital 
compression and switching functions. In one embodiment, each processing card 404 is 
capable of processing 1024 simultaneous sessions. The processing card 404 then sends the 
messages from the DSP to cell switch fabric 410, which is primarily responsible for the 
routing and transferring of messages or data cells, the basic transmission unit, between 
switch elements. The switch fabric 410 may also provide cell buffering, traffic concentration 
and multiplexing, redundancy for fault tolerance, multicasting or broadcasting, and cell 
scheduling based on delay priorities and congestion monitoring. Switch fabric 410 
ultimately routes the messages to egress cards 408a or 408b. In one embodiment, each 
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egress card 408 is capable of handling at least 8000 calls. Egress cards 408a and 408b 
typically send the messages to a gigabit Ethernet (not shown). As its name indicates, the 
gigabit Ethernet supports data rates of one (1) gigabit (1,000 megabits) per second. 

[0023] Turning now to FIGURE 5, a schematic diagram illustrating a packet operating 
system 500 with redundant control cards 502a and 502b is shown. Control cards 502a and 
502b are housed within a single chassis, such as switch 400 (FIGURE 4). Messages 504 
enter packet operating system 500 through interface 506 on control card 502a. Messages 504 
travel from interface 506 onto protocol stack 508 and then to peripheral component 
interconnect ("PCI") bus 510. PCI bus 510 sends messages 504 to either input/output ("I/O") 
cards 512 or DSP cards 514. Control card 502b mirrors either a portion or all of the data of 
control card 502a. Each control card 502a and 502b of packet operating system 500 has its 
own memory and thus avoids the typical problems associated with shared memory, such as 
recursive calls and have synchronization and corruption problems. 

[0024] FIGURE 6 is a schematic diagram illustrating a message scheduling system 600 in 
accordance with the present invention. The scheduling system 600 of the present invention 
includes a scheduler 602 communicably coupled to a first queue 604 and a second queue 606. 
The first queue 604 may be a first-in-first-out ("FIFO") queue. As a result, the scheduler 602 
stores messages in the first queue 604 (line 610) in the order they are received. Similarly, the 
scheduler 602 pulls or schedules queued messages from the first queue 604 (line 612) in the 
order they were stored in the first queue 604. The second queue 606 may be a 
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multidimensional queue and may be described as a "set" of queues wherein the first square 
along the X-axis and Y-axis, such as square 606A, represents the head of a queue. Note that 
the second queue 606 is not limited to a three-dimensional queue as depicted in FIGURE 6. 
Each queue within the second queue 606 is designated to receive messages based on one or 
more of the attributes of the message. The one or more message attributes may include a 
message priority, a virtual private network ("VPN") classification, a destination software 
function, other attributes that distinguish one message from another, or combinations thereof. 
Message priority can be based on QoS parameters or the type of message, such as data, fax, 
image, multimedia, voice, etc. VPN classification can be individual VPNs or groups of 
VPNs. For example, one possible configuration of the second queue 606 could be based on 
VPN classification in the X-direction, message priority in the Y-direction, and FIFO in the Z- 
direction. 

[0025] The scheduler 602 stores messages 608 in the second queue 606 using a scheduling 
algorithm that is data driven based on one or more attributes of the messages 608 and may 
favor one attribute over another attribute. For example, the scheduling algorithm may favor 
higher priority messages. However, the scheduling algorithm will still balance the VPN. 
Additionally, it is also efficient to process messages 608 based on the processing entity 
(function); the same type of function will require the same type of processing. A semaphore 
or counter can drive the tasking. 
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[0026] The scheduler 602 pulls or schedules queued messages from the second queue 606 
based on one or more operating criteria 618, such as historical operating data, current 
operating data, one or more anti-starvation criteria, one or more of the message attributes as 
described above, or combinations thereof For example, processor 620 may have spent a 
large amount of processing on messages 602 with a high priority. Therefore, the scheduling 
algorithm may drive scheduler 602 to begin selecting messages (line 616) from the second 
queue 606 that have lower priorities but have a common VPN or processing entity (function). 
Once the scheduler 602 pulls or schedules a queued message, whether from the first queue 
604 or the second queue 606, the scheduler 602 sends the message to the processor 620. 

[0027] Alternatively, there can be multiple dispatchers with a preemption table such as: 



DST1 


Local 


DispQueue #1 


DST2 


Remote 


Node Y 


DST3 


Local 


DispQueue #2 



The destination entity is looked up in the preemption table or message routing table. If the 
destination entity is remote, such as DST 2, the message is passed to the messaging system 
for transport to the appropriate node, such as Node Y, and the local dispatchers are not 
involved. If, however, the destination was local, such as DST 1 or DST 3, or if the 
messaging system delivers a received message for an entity which is local, then the message 
routing table will indicate which local dispatcher's queues should handle the message. The 
system could be designed so that, for example, messages placed in the queue for DST3, 
DispQueue #2, would take priority over messages placed in the queue for DST 1, DispQueue 
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# 1. As a result, processing on messages done by a lower priority dispatcher will immediately 
be preempted until the highest priority dispatcher has no messages left to process, at which 
time processing will resume in the next higher priority dispatcher that has messages left to 
process. 

[0028] The scheduler 602 has at least two operating modes. The first operating mode 
includes receiving messages 608, storing each message in the first queue 604 based on a first- 
in-first-out order (indicated by arrow 610), and pulling or scheduling each queued message 
from the first queue 604 based on the first-in-first-out order (indicated by arrow 612). The 
first operating mode is configured to quickly process messages 608 during low message 
traffic conditions. The second operating mode includes receiving messages 608, storing each 
message in the second queue 606 based one or more message attributes (indicated by arrow 
614), and pulling or scheduling each queued message from the second queue 606 based on 
one or more operating criteria (indicated by arrow 616). The second operating mode is 
configured to efficiently process messages 608 during high message traffic conditions to 
reduce congestion while maintaining QoS for all message types. 

[0029] The scheduler 602 operates in the first operating mode during low message traffic 
conditions, which may be determined in the rate at that messages 608 are being received and 
processed or more simply by whether or not the number of messages in the first queue 604 
exceeds a first predetermined value; then it switches modes. The first predetermined value 
may be a fixed number of messages or a variable number of messages based on the rate that 
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messages 608 are being received and being processed, or based on other operating 
parameters. As will be appreciated by those skilled in the art, the present invention can be 
configured to operate with more than two queues and in numerous other operating modes to 
accommodate specific processing goals, applications or traffic conditions. 

[0030] For example, the scheduler 602 of the present invention may include a third and 
fourth operating mode to serve as transitional operating modes when the scheduler 602 
switches from the first operating mode to the second operating mode, and from the second 
operating mode to the first operating mode. The scheduler 602 may switch to the third 
operating mode when the number of messages in the first queue 604 equals or exceeds a first 
predetermined value or some other trigger point. At this point, the scheduler 602 ceases 
storing messages in the first queue 604 (line 610) and begins storing messages in the second 
queue 606 (line 614) based on one or more attributes of each message. However, the 
scheduler 602 continues pulling or scheduling queued messages for processing from the first 
queue 604 (line 612) until the first queue 604 is empty. Once the first queue 604 is emptied, 
the scheduler 602 operates in the second operating mode and pulls or schedules queued 
messages for processing from the second queue 606 (line 616) based on one or more 
operating criteria. During the fourth operating mode, the scheduler 602 stores messages in 
the first queue 604 and pulls or schedules queued messages from the second queue 606 based 
on one or more operating criteria. The scheduler 602 switches to the fourth operating mode 
when the number of messages in the second queue 606 is equal to or less than a second 
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predetermined value or some other trigger point is reached. The second predetermined value 
may be a fixed number of messages or a variable number of messages based on the rate that 
messages 608 are being received and being processed, or based on other operating 
parameters. The fourth operating mode is maintained until the second queue 606 is emptied. 
Then the scheduler 602 returns to the first operating mode and pulls or schedules queued 
messages for processing from the first queue 604 (line 612). The scheduler 602 operating 
modes can be summarized as follows: 



Operating Modes 
First 
Second 
Third 
Fourth 



Store Messages In 
First Queue 
Second Queue 
Second Queue 
First Queue 



Pull Messages From 
First Queue 

Second Queue 
First Queue 

Second Queue 



[0031] Now referring to FIGURE 7, a flowchart illustrating a method for storing messages 
into queues 700 in accordance with one embodiment of the present invention is shown and 
will also be described in reference to FIGURE 6. The method 700 is based on a low message 
traffic mode (first operating mode), a high message traffic mode (second operating mode) 
and two transition modes (third and fourth operating modes). The method 700 begins in 
block 702 where the scheduler 602 is initialized with the desired operating parameters and 
starts offset to the first operating mode. The scheduler 602 receives the next message 608 in 
block 704. If the scheduler 602 is operating in the first operating mode, as determined in 
decision block 706, and under low message traffic conditions, as determined in decision 
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block 708, the scheduler 602 stores the message 608 in the first queue 604 in block 710, 
which is also indicated by line 610. The scheduler 602 then returns to block 704 to receive 
the next message 608. If, however, the scheduler 602 is operating in the first operating 
mode, as determined in decision block 706, and not under low message traffic conditions, as 
determined in decision block 708, the scheduler 602 is set to the third operating mode in 
block 712 and determines where to store the message 608 in the second queue 606 based on 
one or more attributes of the message 608 in block 714. The scheduler 602 then stores the 
message 608 in the second queue 606 in block 716, which is also indicated by line 614. The 
scheduler 602 then returns to block 704 to receive the next message 608. 

[0032] If, however, the scheduler 602 is not operating in the first operating mode, as 
determined in decision block 706, and is operating in the third operating mode, as determined 
in decision block 718, the scheduler 602 determines where to store the message 608 in the 
second queue 606 based on one or more attributes of the message 608 in block 714. The 
scheduler 602 then stores the message 608 in the second queue 606 in block 716, which is 
also indicated by line 614. The scheduler 602 then returns to block 704 to receive the next 
message 608. 

[0033] If, however, the scheduler 602 is not operating in the third operating mode, as 
determined in decision block 718, and is operating in the second operating mode, as 
determined in decision block 720, and is operating in high message traffic conditions, as 
determined in decision block 722, the scheduler 602 determines where to store the message 
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608 in the second queue 606 based on one or more attributes of the message 608 in block 
714. The scheduler 602 then stores the message 608 in the second queue 606 in block 716, 
which is also indicated by line 614. The scheduler 602 then returns to block 704 to receive 
the next message 608. If, however, the scheduler 602 is not operating under high message 
traffic conditions, as determined in decision block 722, the scheduler 602 is set to the fourth 
operating mode in block 724. The scheduler 602 then stores the message 608 in the first 
queue 604 in block 710, which is also indicated by line 610, and returns to block 704 to 
receive the next message 608. If, however, the scheduler 602 is not operating in the second 
operating mode, as determined in decision block 720, which means the scheduler 602 is 
operating in the fourth operating mode, the scheduler 602 stores the message 608 in the first 
queue 604 in block 710, which is also indicated by line 610, and returns to block 704 to 
receive the next message 608. 

[0034] Referring now to FIGURE 8, a flowchart illustrating a method for pulling or 
scheduling queued messages from queues for processing 800 in accordance with one 
embodiment of the present invention is shown and will also be described in reference to 
FIGURE 6. The method 800 is based on a low message traffic mode (first operating mode), 
a high message traffic mode (second operating mode) and two transition modes (third and 
fourth operating modes). The method 800 begins in block 802 after the scheduler has been 
initialized with the desired operating parameters and starts off set to the first operating mode 
(see description associated with block 702 (FIGURE 7)). If the scheduler 602 is operating in 
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the first operating mode, as determined in decision block 804, the scheduler 602 pulls or 
schedules the next queued message from the first queue 604, as shown by line 612, and sends 
it to the processor 620 in block 806. The scheduler 602 then returns to decision block 804 to 
pull or schedule the next queued message for processing. If, however, the scheduler 602 is 
not operating in the first operating mode, as determined in decision block 804, and is 
operating in the third operating mode, as determined in decision block 808, and the first 
queue 604 is not empty, as determined in decision block 810, the scheduler 602 pulls or 
schedules the next queued message from the first queue 604, as shown by line 612, and sends 
it to the processor 620 in block 806. The scheduler 602 then returns to decision block 804 to 
pull or schedule the next queued message for processing. If, however, the first queue 604 is 
empty, as determined in decision block 810, the scheduler 602 is set to the second operating 
mode in block 812. The scheduler 602 then determines the next queued message to pull or 
schedule from the second queue 606 based on one or more operating criteria in block 814. 
Next, the scheduler 602 pulls or schedules the selected queued message from the second 
queue 606, as shown by line 616, and sends it to the processor 620 in block 816. The 
scheduler 602 then returns to decision block 804 to pull or schedule the next queued message 
for processing. 

[0035] If, however, the scheduler 602 is not operating in the third operating mode, as 
determined in decision block 808, and is operating in the second operating mode, as 
determined in decision block 818, the scheduler 602 determines the next queued message to 
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pull or schedule from the second queue 606 based on one or more operating criteria in block 
814. Next, the scheduler 602 pulls or schedules the selected queued message from the 
second queue 606, as shown by line 616, and sends it to the processor 620 in block 816. The 
scheduler 602 then returns to decision block 804 to pull or schedule the next queued message 
for processing. If, however, the scheduler 602 is not operating in the second operating mode, 
as determined in decision block 818, which means the scheduler 602 is operating in the 
fourth operating mode, and the second queue 606 is not empty, as determined in decision 
block 820, the scheduler 602 determines the next queued message to pull or schedule from 
the second queue 606 based on one or more operating criteria in block 814. Next, the 
scheduler 602 pulls or schedules the selected queued message from the second queue 606, as 
shown by line 616, and sends it to the processor 620 in block 816. The scheduler 602 then 
returns to decision block 804 to pull or schedule the next queued message for processing. If, 
however, the second queue 606 is empty, as determined in decision block 822, the scheduler 
602 is set to the first operating mode in block 822. The scheduler 602 then pulls or schedules 
the next queued message from the first queue 604, as shown by line 612, and sends it to the 
processor 620 in block 806. The scheduler 602 then returns to decision block 804 to pull or 
schedule the next queued message for processing. 

[0036] Although preferred embodiments of the present invention have been described in 
detail, it will be understood by those skilled in the art that various modifications can be made 
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therein without departing from the spirit and scope of the invention as set forth in the 
appended claims. 
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